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Based only on classical Hamiltonian dynamics, we prove the maximum work principle in a system 
where macroscopic dynamical degrees of freedom are intrinsically coupled to microscopic degrees of 
freedom. Unlike recent identities between irreversible work and free energy, such as in the Jarzynski 
relation, the macroscopic dynamics is not governed by an external action but undergoes the back 
reaction of the microscopic degrees of freedom. Our theorems cover such physical situations as 
impact between macroscopic bodies, thermodynamic machines, and molecular motors. 
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The second law of thermodynamics is one of the most 
important principles in physics. Since its initial concep- 
tion various formulations have coexisted and correspond- 
ing derivations from microscopic mechanics have been ar- 
gued (and criticized). Most valuable in that respect re- 
mains the recognition by the founding fathers Maxwell, 
Boltzmann, Gibbs and Einstein of the importance of the 
huge separation between microscopic and macroscopic 
scales. The second law indeed realizes a bridge between 
the microscopic physics laws and the macroscopic reality. 

In the present letter we consider a mechanical system 
containing a huge number of degrees of freedom. The 
macroscopic motion of the system is coupled directly 
and generally with these microscopic degrees. We focus 
on the second law in its maximum work formulation 0, 
getting an upper bound for the change in energy of the 
macroscopic degrees of freedom in terms of the change 
in free energy. To our knowledge the present rigorous 
derivation starting from Hamiltonian dynamics is unique 
in that respect. An advantage of our formulation is that 
we deal only with macroscopic energy transfer, whose me- 
chanical definition (unlike that of entropy) is manifest. 

Our work has to be contrasted with the results in 
concerning e.g. irreversible work - free energy rela- 
tions, where one always treats the dynamics of the macro- 
scopic coordinates as operated upon by an external agent. 
The operation is there implemented as time-dependent 
Hamiltonian, whose time-dependence follows a protocol 
which is fixed prior to the operation. In other words, the 
external agent is never affected by back-reaction from the 
system under operation. Such an idealization is justified 
if, for example, a gas in a cylinder is compressed by mov- 
ing an infinitely heavy rigid piston whose motion or shape 
is never affected by the behavior of the gas. In reality, 
however, any part (including the piston) of a physical 
system obeys its equation of motion, and is also affected 
by the motion of other constituents of the same system. 
It is therefore desirable (if only from a theoretical point 
of view) to treat macroscopic degrees of freedom as truly 
dynamical degrees of freedom. 

There are however much more delicate situations where 
macroscopic (or mesoscopic) motions are coupled intrin- 



sically with microscopic degrees of freedom and where 
our treatment becomes very relevant. Examples include 
impact between several macroscopic bodies, various ther- 
modynamic machines, and biological molecular motors. 
In these systems, one may never treat macroscopic (or 
mesoscopic) motions as pre-fixed protocols. 

There has recently been a revival in attempts to ex- 
plore the boundaries of the second law. e.g. in Q. Here 
we stick to derivations of the second law in the average, 
not focusing on path-dependent fluctuations of work or 
entropy. Instead of presenting a conceptually unifying 
and general scheme for second law scenario's and deriva- 
tions such as in we prove concrete estimates for a 
specific set-up which is wide enough to cover such inter- 
esting physics as limitations on the working of biological 
and thermodynamic engines and as the impact of macro- 
scopic bodies. Discussions of various related issues and 
extensions to quantum systems will appear elsewhere j3] . 

Setting — Consider an isolated classical mechanical 
system consisting of N (microscopic) particles confined 
in a finite volume. We start from a completely arbitrary 
TV-body Hamiltonian 
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f/tot(fi, 



(1) 



where f^-, Pj, and are the coordinate, the momentum, 
and the mass, respectively, of the j-th particle. The po- 
tential C/t,ot(fi, ■ • ■ , ^n) is arbitrary, and represents both 
the interaction between the particles and the external 
forces acting on them. 

We imagine that is a huge number, and we extract 
n degrees of freedom, with n — 0(1), to describe the 
macroscopic motions in the system. We let /i , . . . , /„ C 
{!,..., N} be non-overlapping sets of indices (where we 
do not assume U"^j/i = {!,..., iV}), and denote by 
"^i Z]je/. the mass, by v., (Dje/, Mjfj)/"^-* 
the center of mass, and by Pi :— Pj the mo- 

mentum, respectively, of the i-th macroscopic body |^. 
We denote these macroscopic coordinates collectively as 
R := ( ri, . . . ,r„) and P := (pi, . . . ,Pn). We denote the 
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canonical coordinates and momenta of all the remain- 
ing 3(A^ — n) microscopic degrees of freedom collectively 
as X. One should think of the macroscopic degrees of 
freedom described by R, P as our observable and con- 
trollable system, while the X describe the internal and 
uncontrolled reservoir- like variables. 

Using these new variables, we decompose the total 
Hamiltonian ^ as TJtot = H{P, TV) + h-R{X), where 

J^(P,R)=5]^ + [/(R), (2) 

z— 1 

is the macroscopic part and /ir(X) is the remaining mi- 
croscopic part of the Hamiltonian. Although this decom- 
position is not unique, our main results do not depend 
on the particular decomposition. Note that /ir(X) can 
depend on the macroscopic position R (but not on P) 
while H(P, R) does not depend on X. 

The internal degrees of freedom X are initially in a 
restricted thermal equilibrium; the macroscopic degrees 
of freedom (P, R) start sharply peaked around some fixed 
values. More precisely we sample the initial condition 
(P,R, X) according to the probability distribution 

MP, R, X) ^ i?o{P, R) e-'3{''R(^)-^'o(R)} e C(R)]. 

.(3) 

A priori iyo{P, R) can be taken as an arbitrary normalized 
distribution, but we usually take it as a distribution that 
is peaked around fixed values P^^^ and R(°^ The X are 
in thermal equilibrium at inverse temperature [3 = 1/ kT 
but with a possible restriction; a typical example being a 
gas confined in a certain region. Here is the indicator 
defined by xftrue] = 1 and x [false] = 0, and C(R) is 
the range of X determined by the initial (macroscopic) 
setting. The (restricted) free energy is then ^o(R-) ~ 
-/3-ilog/dXe-^'^^Wx[^ €C(R)]. 

After choosing the initial state (P,R, X) according to 
0, the system evolves following the Hamiltonian dy- 
namics determined by (and thus possibly leaving the 
initial constraint C(R)). While there is little hope of solv- 
ing the fully interacting iV-particle dynamics exactly, we 
can nevertheless derive completely rigorous inequalities 
about the energy transfer. 

Main results — Let ft(P,R, X) be the prob- 
ability distribution at time t > Q determined 
uniquely from the initial distribution Q and from 
the Hamiltonian dynamics. We denote by (• • •)( = 
J dPdHdX vtiP, R, X) (• • •) the corresponding expecta- 
tion value. Let £^t(P,R) / i/f (P, R, X) be the 
probability distribution at t of the macroscopic degrees of 
freedom, and := - / dPdRi>t(P,R) log£>t(P,R) the 
corresponding Shannon entropy. We finally let -F'(R) ~ 
— /3~^log/ dX e~ ^^'^-^^ be the free energy without re- 
striction. 

Theorem 1 — For any i > 0, one has 
{H)t - {H)o < (Fo(R))o - (F(R))t + ^iSt - So). (4) 



A first useful interpretation of that bound may be ob- 
tained by rewriting Q as 

(F(R)), + {{H), - St/13) < (Fo(R))o + ((i/)o - So/f3), 

(5) 

implying that the total free energy, when properly de- 
fined as above, cannot increase in time. One can further 
rewrite (jSJ in the form of the Clausius inequality 0, 0| . 
Another important interpretation of Q will be discussed 
as the example ii) below. 

One expects that the change St — Sq of the entropy 
of the macroscopic part is of 0(1) for a suitable choice 
of the initial distribution. To show this precisely, we 
further specify the situation. Let us take for i>o(PjR-) 
the uniform distribution in a very small region of the 
phase space around a fixed initial value (P^^^R^^^). 
The volume of the region in the P-space is taken to be 
v-m — n"=i (2'7ii//3)'^^^, which roughly means that each 
component of the momenta can fluctuate only of the or- 
der of the thermal momentum •y/2mi//3. The volume of 
the region in the R-space is Vc = (I'o)", where vq is a 
very small spatial volume that corresponds to the ini- 
tial fluctuation of the center of mass of the macroscopic 
bodies. 

Let us fix the final time t > 0. We assume that the 
final distribution i't(P, R) is nonvanishing only when R G 
TZ, where 7?. is a finite region with the (3n-dimensional) 
volume Vc- When the whole system is enclosed in a box 
of volume V, we can take Vc = V^. We write rj — Vc/vc- 
Finally we define 

K ^ P [max'{ff (P, R) + Fo(R)} - min {t/(R) -I- i^(R)} ] , 

(6) 

where the maximum is taken over (P,R) such that 
i>o(P,R) 7^ 0. The quantity K may be interpreted as 
the maximally allowed kinetic energy of the macroscopic 
part in the final state when one assumes that the maxi- 
mum work principle is valid. 

Theorem 2 — For any t > 0, one has 

{H)t -{H)o<{Fo)o- {F)t + ^(log77 + S), (7) 

where S < (3n/2)log(A' -I- log??) -I- c„ if AT > Kn, and 
S < bn if K < Kn- Here Kn, Cn, and 6„ are constants 
which depend only on n . 

The quantity log 77 -I- 5 is indeed of 0(1) for normal 
macroscopic systems Then we can rewrite ^ as 

W < {Fo{R))o - {F{K))t + O(kT), (8) 

where W = (i/(P,R))t - (i/(P,R))o is the total work 
done to the macroscopic part by the internal (micro- 
scopic) part. Since 0{kT) is a negligibly small energy 
for macroscopic bodies, JSJ implies the maximum work 
principle, which says that the work done on the system 
(the macroscopic coordinates (P,R)) cannot exceed the 
decrease of the free energy of the reservoir, here played 
by the internal degrees of freedom X. Note that the 
term 0{kT) while small and practically irrelevant on 
macroscales, cannot be avoided in principle. 
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Examples — i) Macroscopic impact: Suppose that 
one has (Fo(R))o = (F(R))t for the free energy of 
the internal degrees of freedom. Then JHl becomes 
(iif(P,R))t < (i/(P,R))o, which means that macro- 
scopic or collective motion gets halted; the energy stored 
in the macroscopic part flows to the internal degrees. 

Typical and important examples are impact between 
macroscopic bodies. Consider a system of n macro- 
scopic bodies, each of which consists of a huge number of 
"molecules." The microscopic potential t/tot(f i) ■ • ■ , ? at), 
which we assume to be translation invariant, describes 
binding forces within each body and interactions between 
the different bodies when they come close to each other. 

We assume that, initially (i.e., before the collision) and 
finally (i.e., after the collision), all the bodies are suffi- 
ciently apart from each other so that we have U (R) = 
with probability one. We also assume that initially the 
internal degrees of freedom within each body are in their 
unrestricted equilibrium. Thus we have (i^o(R-))o = 
(i^(R))t, and JSJl implies 
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< O(fcT), 



(9) 



where 0{kT) is determined hy K — (3 X^iLi |Pi P/ (2mi) 
for pI"'' the initial momentum. In the simplest case of 
an impact between two bodies, that implies the (well- 
known) fact that the coefficient of restitution does not 
exceed unity, proved before in a stronger form but in a 
special setting with a high symmetry iU\. Here the fact 
is proved in great generality 11] . 

ii) Thermodynamic machines: We can treat various 
"machines" whose initial state stores extra free energy 
in such forms as a difference in pressure or chemical po- 
tential. Then the extra free energy may be converted 
into mechanical energy by relaxing the constraints. Our 
bound ^ states that the extracted mechanical work can 
never exceed the difference between the initial free energy 
and the final equilibrium free energy. 

Hi) Molecular motor: If the macroscopic part settles 
at time t to a configurationally equivalent state as the 
initial state, we can assume Sq = St- Then Q yields 
the maximum work principle W < (i^o(R-))o — {P{'^))t 
without a small correction. 

The above assumption is justified in the so called 
steady state regime, in which the macroscopic part makes 
a successive transition between quasi stationary states. 
An important example is the rotational motion in a 
molecular motor such as the Fi ATP synthase T^. We 
identify the rotational degrees of freedom of the motor as 
the single macroscopic coordinate, and couple it with an 
external potential (provided, for example, by an elastic 
filament attached to the "rotating shaft" of the motor). 
We choose the initial state as the moment where an ATP 
is captured by the motor protein, and assume that the 
ATP hydrolysis proceeds as a semi-mechanical process 
synchronized with the rotational motion. Then we may 
assume (-Fb)o — {F)t is equal to AGatp — 20fcr, which 



is the free energy released in the hydrolysis of an ATP. 
Our bound igj) implies {U{ri))t - (C/(ri))o < AGatp, 
which guarantees that the second law is valid in average. 
Obviously, for such small systems like molecular motors, 
fluctuations may be more important than in usual ther- 
modynamics for large systems. 

Proof of Theorem 1 — We fix the final time t > Q 
throughout the proof. Let us denote the initial coor- 
dinates collectively as F = (P,R, A"). It is convenient 
to denote the state at time t by different variables as 
F' = (P',R', A'). There is a one-to-one correspondence 
between F and F' determined by the time-evolution. 
When we regard one of them as a function of the other, 
we explicitly write F(F') or F'(F). We also freely use 
notations like P(F') or A'(F). 

Let us consider a probability distribution at time t 



^,(F') = At(P', R') 



(10) 



where /!tt(P',R') is a normalized distribution which will 
be chosen later. We denote by /io(F) the probability dis- 
tribution at the initial time obtained from the inverse 
time evolution. We follow the idea in Q, and examine 
the relative entropy 



'^o(r) 



D{iio\vo) j dTvo{T) log 



Mo(r) 

dV'vtiV') logA.t(F'|ll) 



where the final expression follows from the Liouville the- 
orem. By using the explicit form (|3Jl and I|1U|) . we get 

D{^lo\vo) = y"dF 1.0(F) [log z)o(P,R)-/3{/ir(A)-^^o(R)}] 
- j dV vt{V') [logMt(P', R') - P{hTi'{X') - F(R')}] 



--5o-/3(/iR(A))o-l-/3(i^o(R))o 
+S{vufit) + (i{hTi'{X'))t - /5(F(R'))t, 

where we have defined 

S{i)ufit) = - J rfP'rfR'i>t(P',R') logMt(P',R')- (13) 

By using the energy conservation law {H(P, R) -|- 
hR{X))o = {H{P', R') + /iR'(A'))t and the fact that the 
relative entropy Z3(/iQ|i'o) is always nonnegative, we get 
our basic inequality 

(i/(P',R'))t-(i/(P,R))o 

< (Fo(R)>o - (i^(R'))t + ^{Sih, h) - So}. (14) 

By choosing fit(P' , R') — ^'t(P'i R') (which is indeed the 
best choice), (I14II reduces to the desired (0} which ends 
the proof of Theorem 1. 



(12) 
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Proof of Theorem 2 — We first control the distribu- 
tion i>t{P') ■■= J dR'dXVt(r'). We again use the Liou- 
ville theorem, the energy conservation, and to get 

z>t(p') - j dn'dx'MTiv')) 

= J dR'dx'j>o(P(r'),R(r'))x[^(r') eC(R(r'))] x 

X exp[/3{-/iR,(X') - i?(P', R') 

+i?(P(r'),R(r')) + Fo(R(r'))}] (i5) 

We can bound that from above by replac- 
ing iJ(P(r'),R(r')) and Fo(R(r')) by i/™^'^ = 
max'(p ^)i/(P,R) and i^™ax ^ max'(p ^)Fo(R) (where 
the max are taken over (P, R) such that £'o(P: R-) 7^ 0), 
respectively, and iJ(P',R') by X;r=i Ip»IV(2to») + f/""" 
where C/™™ = minR/g^ t/(R')- After these re- 
placements, we can perform the X' integral to 
get /dX'e-'^^K'C^') = e-/3f^(R') < ^-PF"^"^ ^-^^^ 
pmin ^ minR/gTCF(R'). We finally use the bound 
i/o(P,R) < {vcVm)~^, and then integrate over R' to get 
the total volume Vc- The final result reads 

.>,(P')<f exp[-/35]|iL+x], (16) 

with K := /3{if5"^'^ + Fo'"^'' - f/""" - F'"''^} which is the 
same as The bound l|16|) shows that the probabil- 
ity to find large final kinetic energy decays exponentially 
for sufficiently large energy; the bound will prove to be 
essential for our final estimate. 

We use to bound S{i>t,flt)- Since /it(P', R') is ar- 
bitrary, we choose it as Ait(P', R') = fi{P') (K)"^ e 
TZ], where fi(P') will be chosen later. Then we get 
Sii>t,fxt) = logye + ^ with 5= - /dP'£>(P') logA(P')- 
To bound S, we make a change of variables. Let — 



y/f3/{2mi) P-, and t = (ti, . . . ,t„) G R^". Correspond- 
ingly we set D{t) :— i^(P') and p.{t) := v^n A(P') 
with (as before) = nr=i(2'™i//^)'^^^- Then we have 
S = logi^m -I- S with S = — J dtD{t) log/i(t). Since 
Sq = log(fcWin) for the present initial distribution, the 
basic inequality ifT^ reduces to (|7)). 

The remaining task is to bound S by using H16() : i^(t) < 
exp(— |tp -f X') with if' = if -I- log 77. That is an elemen- 
tary technical problem, which can be solved in various 
manners. Let us present a simple bound. Take a constant 
A > such that va := >^ exp[- exp[|tp/2]] < 
1/2 (where |t|oo = niaxf"i \ti\). Then we set ^(t) = 
exp[-exp[|t|V2]] for |t|oo > A, and ^(t) (2A)-3"(1 - 
va) > {2(2A)3"}-i for |t|oo < A, satisfying / dt p(t) = 
1. With that choice of p,{t), we bound S as 

5 < log{2(2A)3"} + f dte-l*l'/2+^'. (17) 
The integral in the second term is bounded as 

< 3n(27r)3"/2e^'-^'/2, (18) 

where we noted that dte~*^^^ = ds 6^'"+"^'^/^ < 
e~^'/2/p°°dse-'''/2_ We A = (provided that 

this value is large enough to guarantee va < 1/2) to get 
S < logiK')^"^/^ + log{2(2v^)3"} -I- 3n(27r)3"/2. ^j^^^ 
K' is not large enough, we choose A to be the minimum 
allowed value. 
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